Fast closed-loop optimal control of ultracold atoms in an optical lattice 
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We present experimental evidence of the successful closed-loop optimization of the dynamics of 
cold atoms in an optical lattice. We optimize the loading of an ultracold atomic gas minimizing the 
excitations in an array of one-dimensional tubes (3D- ID crossover) and we perform an optimal cross- 
ing of the quantum phase-transition from a Superfluid to a Mott-Insulator in a three-dimensional 
lattice. In both cases we enhance the experiment performances with respect to those obtained via 
adiabatic dynamics, effectively speeding up the process by more than a factor three while improving 
the quality of the desired transformation. 
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In the last decade, the implementation of quantum 
simulators with cold atoms has experienced remarkable 
expansion [1 . The latest developments in the field have 
made now possible to experimentally investigate Fermi 
and Bose ultracold gases in many different setups [2"]. 
Optical potentials have given access to the simulation of 
the ground-state physics and the dynamics of some of 
the most important lattice models: Hubbard and spin 
models have been successfully implemented [3- 7 . In- 
cluding artificial disorder enables the study of ubiqui- 
tous phenomena like Anderson localization [8 . Recently, 
improved experimental techniques allowed for the ac- 
quisition of unprecedented single-atom resolved images 
and the coherent control of single spins [9l |10] paving 
the way for the next generation of experiments. Novel 
and more challenging ideas have been proposed to ex- 
ploit the potential of quantum simulators to study arti- 
ficial gauge fields related to quantum Hall physics [11], 
the physics of complex quantum systems [12 and gauge 
theories [13 . The path towards new experiments of in- 
creasing complexity is conditional on the development 
of better and more precise experimental techniques, to 
achieve increased control on the system under investiga- 
tion. The necessary steps to be taken are mostly related 
to technological and experimental development, however 
recently an important theoretical contribution has been 
put forward. Indeed, it has been shown that it is pos- 
sible to exploit quantum optimal control to synthesize 
optimal strategies for correlated quantum many-body dy- 
namics [SI [15], as already known for few-body or uncor- 
related quantum systems [TBHTO] . Combining numerical 
simulations and novel approaches has enabled optimal 
control of correlated quantum many-body dynamics and 
optimal driving of phase transitions [IT, 'SiD and the engi- 
neering of many-body entangled and squeezed states [21 . 
Despite these promising theoretical results, their experi- 




FIG. 1: Scheme of closed-loop optimization experiment. The 
control-field s (t) describes the temporal dependence of the 
lattice depth during the loading of the atomic gas in the lat- 
tice. An initial guess so(t) is chosen: for each experimental 
run and a Time-Of-Flight image is recorded. From a double- 
structure fit of the density distribution we extract the Figure 
Of Merit F. The optimization algorithm provides an updated 
function s{t) and the experiment is repeated until reaching an 
optimal field Sf(t). 



mental implementation might be limited by different is- 
sues mainly arising from discrepancies between theoret- 
ical models and experimental realization. Even though 
optimal control fields are generically robust against noise 
and imperfections [22], it would be desirable to have an 
optimal control field obtained by means of the most ac- 
curate and comprehensive description possible of the sys- 
tem dynamics under consideration. Moreover, there are 
also cases where open-loop quantum optimal control can- 
not be applied to a given dynamics as no efficient classical 
description is available, for example in highly-entangled 
quantum many-body systems in dimension greater than 
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one [23]. These limitations might be overcome by means 
of closed- loop optimal control, i.e., the application of op- 
timal control in a loop that includes experiments, where 
the control fields are updated at each step after a direct 
measurements of a Figure Of Merit (FOM) (see Fig. [l] 
for the case discussed in this paper). This approach has 
the great advantage of taking all sources of uncertain- 
ties automatically into account, such as for example lim- 
ited knowledge of system parameters, errors, and con- 
straints. Indeed, closed-loop optimization has been suc- 
cessfully applied in different contexts, from NMR to fem- 
tosecond laser driving of molecular dynamics [16 . Our 
approach, based on Chopped RAndom Basis (CRAB) 
optimization, has the additional nice feature of avoiding 
complex broadband control fields, and it is simple to be 
implemented in the lab. On top of that, CRAB optimiza- 
tion might be used to find simple but unknown optimal 
control fields that might be exploited in similar or fol- 
lowing repetitions of the experiment. Indeed, this has 
been shown to be the case for the open-loop control of 
Rydberg atom dynamics where a CRAB optimization on 
different disordered samples guided the design of a robust 
optimal control field [24 . 

In this Letter we apply optimal control theory to give 
the first experimental demostration of a closed-loop op- 
timal loading of an ultracold atomic sample in optical 
lattices. We demonstrate the possibility of guiding the 
system from an initial to a final state through a non- 
adiabatic transformation, such that the final state is 
reached in a shorter time and with a better fidelity with 
respect to a slower quasi-adiabatic procedure. We op- 
timize two different fundamental processes that appear 
in many different cold atoms experiments. We first op- 
timally load a Bose-Einstein condensate (BEC) of ^^Rb 
atoms in a two-dimensional optical lattice in order to pro- 
duce an array of one-dimensional gases. Afterwards, we 
optimally drive an atomic gas across the quantum phase 
transition from a superfiuid to a Mott insulating phase 
loading the BEC into a three-dimensional optical lattice. 

Experimental setup - A degenerate sample of ^^Rb is 
obtained in a hybrid magneto-optical trap realized with 
the superposition of a quadrupolar magnetic field and a 
focused red-detuned laser beam [2F. After evaporative 
cooling, we obtain a BEC of about 2 x 10^ atoms expe- 
riencing an external harmonic potential with cylindrical 
symmetry [26 . In the slow adiabatic loading proce- 
dure, the lattice potential depth s (t) (expressed in recoil 
energy units Er = /i^/2mA^, where the optical lattice 
wavelength is A = 830 nm, h is the Planck constant and 
m is the atomic mass) is increased exponentially from 
zero to a maximum value Smax in a time At and a time 
constant r according to: 

1 - e*/^ 

S{t) Smax^ _ ^^t/r' ^'^^ 



The lattice intensity is controlled by acousto-optic mod- 
ulators and stabilized at the desired value by a feed- 
back system during the whole transformation. In the 
optimization tests, we compare the non-adiabatic trans- 
formations to an exponential quasi-adiabatic ramp of 
total duration of Atad = 140 ms and time constant 
^ad = 30 ms. The latter is representative of typical ramps 
used in experiments [27 . The extimation of the excita- 
tions produced in the gas by the non-adiabatic ramp in 
obtained in the following way. Once the optical lattice 
has reached the maximum intensity Smax^ it is kept at 
this value for 5 ms and then turned off with the time- 
reversed exponential ramp. Then, after a thermalization 
time Atth, all the other confining potentials are switched 
off and the atomic cloud evolves in free space. The energy 
excess of the lattice gas is quantified by measuring the 
thermal fraction from absorption imaging after a time of 
fiight (TOF) of 28 ms, when the thermal and condensed 
parts are well distinguishable [28 . The thermal fraction 
is taken as the FOM to be minimized by the optimiza- 
tion process. Note that the ramping down of the lattice is 
always adiabatic (exponential decreasing ramp with Tad 
and Atad), so that the heating measured at the end of 
this ramp refiects the heating of the gas in the loading 
procedure. 

Optimization - A typical quantum optimal control 
problem is stated as follows: given a system described 
by a Hamiltonian function of a time-dependent control 
field s{t)^ i.e. H = H{s{t)), we aim to extremize a given 
FOM E{s{t)) after the time evolution driven by s{t) in 
the time interval t G [0,At]. CRAB optimization is a 
strategy that solves the aforementioned problem starting 
with an initial guess sq {t) and looks for the optimal con- 
trol field that extremizes the FOM over all the functions 
of the form s{t) = so{t)g{t) where the correction g{t) 
is defined as a truncated expansion in some given basis 
functions. In particular here we assume 

^ _ 1 + Ej^i sin(27r^^-t) + bj cos(27r^^-t)) 

1 + Zljii sin(27r^'j At) + bj cos(27r^'j At)) ' 

(2) 

for some (small) number n/ of components with fre- 
quencies Uj. The optimization problem is then recast 
as an extremization of a mult i- variable function E {{hj}) 
of the variables hj = {aj^bj). Here the minimization 
is performed by means of a Simplex minimization algo- 
rithm [14 . 

In optical lattice experiments, this problem typically 
appears as one aims to prepare a given state varying the 
optical lattice intensity s {t). Indeed, our goal is to pre- 
pare the system ground-state thus minimizing the resid- 
ual excitations in the final state. In particular, first we 
optimize the loading of a BEC in a two-dimensional opti- 
cal lattice as a test of our closed- loop experiment. Then, 
we exploit the CRAB method to optimize the Superfiuid- 
Mott insulator quantum phase-transition. The experi- 
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mental procedure of closed-loop optimization is shown 
in Figjl] we define an initial guess so{t) and implement 
the experimental sequence described above, at the end of 
which a TOF image is recorded. An automated fitting 
procedure results in a measurement of the final thermal 
fraction of the sample TF = ^thf^tot to be compared 
with the initial thermal fraction TF^. Their ratio de- 
fines the FOM F = TF/TF^ we minimize. With this 
information the minimization subroutine implements a 
search in the parameters space that defines an updated 
loading ramp s{t). The loop is then closed and the pro- 
cess repeated until convergence or when the given desired 
precision has been reached. 

3D- ID crossover - We first consider the transforma- 
tion between a three-dimensional BEC and an array of 
one-dimensional quasi-condensates obtained loading the 
BEC in a two-dimensional lattice. As a warm-up for 
the full CRAB optimization, here we optimize the pro- 
cess over a restricted class of functions, namely loading 
ramps of exponential shape with different duration At 
and time constant r as defined in Eq.Q. The final value 
of the two lattices intensity s^ax = 32 is high enough to 
produce an array of independent one-dimensional gases 
where the transverse degrees of freedom are completely 
frozen and the tunneling rate of atoms between differ- 
ent sites is negligible on the time scale of the experi- 
ment. The thermalization time is Atth = 1 s. Before 
running the optimization algorithm, as the final thermal 
fraction is a two-dimensional function of the free param- 
eters (At,r) and thus easily represent able, we plotted 
it in the two-dimensional parameter phase-space (col- 
ored map in Fig. 2(a)). This allows the results of the 
closed-loop optimization to be compared with a brute- 
force approach, that is an extensive search in the param- 
eter space. The colored map gives us interesting infor- 
mation on the problem structure, notice for example that 
for very short ramps the FOM is clearly higher than in 
case of longer ones, as expected. The extensive mapping 
approach is unfeasible as soon as the number of the pa- 
rameters increases, however in this case where only two 
parameters are considered we show that the optimization 
finds very quickly the minima. Fig. [2] presents two tests 
of the optimization loop characterized by the same ini- 
tial guesses A to = 15 ms and tq = 3 ms: F is reported 
for both runs in Fig. |2(b)| as a function of the iteration 
number n of the optimization loop. The possibility of 
finding different final results is due to the fact that per- 
forming an experiment characterized by a finite number 
of iterations and experimental errors, we may bump into 
little deviations in the measurements from run to run. 
As it can be seen, in both cases after a quick convergence 
to a minima the algorithm looks for other solutions pos- 
sibly present in case the first were a local minima, but 
it founds none. In Fig. 2 (a) [ the trajectories in the space 
of parameters clearly reflect this behavior. Finally, as 
reported in the table in Fig. [2j the two loops give two 
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FIG. 2: 3D-1D crossover. 



Two-dimensional mapping 



(blu-colored palette) of the FOM as a function of the param- 
eters At and r. Circles (triangles) show the progress during 
the first (second) run of optimization (grey-colored palette). 



(b) 



Measured figure of merit F (ratio between final and ini- 
tial thermal fraction of the atomic sample) after ramping up 
and down a two-dimensional optical lattice during the opti- 
mization loop. First (second) experimental run (see text) is 
represented by blue circles (red triangles). The two best re- 
sults Fopt measured in the two runs are circled in evidence. 
For completeness, on the right side of the graph we report 
also the corresponding values of the ratio between tempera- 
ture Tf measured after having switched on and off the lat- 
tices and temperature Ti measured before loading the lattices 
(inferred from the thermal fraction assuming thermal equilib- 
rium). The table reports the values of the FOM corresponding 
respectively to the quasi-adiabatic loading, to the exponential 
initial loading (so) and to the best one (sopt) of the two runs, 
together with the correspondent values of the parameters At 
and r. 
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FIG. 3: Optical lattice ramps for the Superfluid - Mott insula- 
tor transition. Solid lines: a) First run initial guess, b) First 
run optimized ramp, c) Second run initial guess, d) Second 
run optimized ramp. The dashed black line represents the 
exponential non-corrected ramp. 



run ended in an improved results while the first missed 
the global minima, spending the available iterations in 
the large region where the FOM is almost flat, as we can 
see in Fig. 2(a)| 

Superfluid- Mott Insulator transition - We now apply 
the closed-loop optimization to a more complex dynam- 
ical process, that is, the loading of the BEG into a 
three-dimensional lattice, effectively optimally driving 
the quantum phase transition from a superfluid to a Mott 
insulator phase. We perform a full GRAB optimiza- 
tion, that is, we search for the best possible correction 
of the form introduced in Eq. J2| to an initial exponen- 
tial ramp so{t) given in Eq. Here we use two fre- 
quency components, i.e., we perform the optimization in 
a four-dimensional parameter space, with ui = 1/At e 
U2 = 2/ At, where At = 40 ms and r = 8 ms. The fi- 
nal optical lattice depth is Smax = 25 - deeply in the 
Mott insulating phase - and the thermalization time 
Atth = 200 ms. As in the previous case, the FOM is 
represented by the normalized thermal fraction F, ob- 
served after an adiabatic switching off of the lattices, 
which measures the residual excitations on top of the 
Mott ground state. In this case, the quasi-adiabatic ramp 
(At = 140ms,r = 30 ms) gives Fad ^ 2.16 (green line in 
Fig. |4|. We have performed two different optimization 
runs characterized by different sets of initial random pa- 
rameters {hj}: In the first one the initial ramp is very 
close to the guess so(t), while in the latter it is character- 
ized by a very strong correction. The resulting optimal 
ramps are shown in Fig. [3) together with the initial ramp 
and the uncorrected (pure exponential) one. It may be 
interesting to note that, despite starting from very dif- 
ferent initial guesses, the two loops result in two very 
similar output ramps, characterized by a slow variation 
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FIG. 4: Optimization of the Superfluid - Mott insulator tran- 
sition. The FOM F is reported as a function of the iteration 
number n (second run). The green region shows the FOM 
Fad = (2.16 ± 0.03) in the case of the quasi-adiabatic load- 
ing (At = 140ms,r = 30 ms). The blue-circled empty square 
reports the final optimal loading Fopt- In the table are re- 
ported the values of the parameters [ai, 61, a2, ^2] of the cor- 
rection and the FOM F corresponding respectively to the 
quasi-adiabatic loading, to the exponential uncorrected load- 
ing (suc) and to the optimal loading (sopt) found in the two 
runs. 



in the first part and a fast increase in the second part. 
The trend of F during the second run is shown in Fig [4] 
The results of the two optimizations are summarized in 
the table. Note that, although the very small number 
of parameters involved in the optimization (nj = 2), we 
obtain a transformation about three times faster than 
the adiabatic one and with a final temperature improved 
by a few percent. Whenever additional improvements 
would be needed for real applications, where improved 
precisions and/or faster ramps are crucial elements for a 
successful experiment - for example to reduce decoher- 
ence effects - the presented optimization can be improved 
adding more optimization parameters and/or increasing 
the optimization runs. 

Conclusions - We have shown for the first time that 
closed-loop optimal control can be effectively applied to 
the manipulation of cold atoms in optical lattices, demon- 
strating how it is possible to develop strategies differ- 
ent from adiabatic ones. In particular we have shown 
that it is possible to drive the 3D- ID crossover and the 
3D Superfluid-Mott insulator transition over time scales 
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about one third shorter than a standard quasi-adiabatic 
one, while stih improving on the final state. Our strategy 
can be applied to the implementation of the ground state 
of different Hamiltonians. This demonstration paves the 
way to further developments that will allow to face the 
challenges of the next generation experiments with cold 
atoms in optical lattice. 
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